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Anti-block noise Filter: algorithm and 

implementation 

1 .0 Purpose of Development 

To encode a MPEG bitstreani, the whole picture is sliced into small microblocks, which 
are transformed into frequency domain and quantized 

The encoding procedures are carried over by hardware or software encoders. Some of 
encoders are real-time running thus constrain 

encoder, either hardware encoder or other hardware like CPUs that carry over the soft- 
ware encoding task, can only encode the number of bits diat the hardware is^c 
When the encoding resources contains quick motion, or too little bandwidth is allocated 
to the left image because of bad bandwidth allocation, or the hardware is in portable 
devices with limited power supply thus cannot run at full speed to avoid eating .up all the 
power, encoders usually provide lower bandwidth on bits representing flat regions and 
non-motion background blocks. Usually the DC value has more priority in bandwidth 
allocation compared to higher fr^uency bits, but If the left bandwidth is too little, the 
DC quantization in the fiat region or background blocks may not be encoded harshly. 
Therefore a decoder cannot reconstruct the decent DC values. 

The bandwidth allocation is dynamic and varies from block to block. A fiat region usu- 
ally cover a big region on display such as quarter size of the screen. If among these 
many flat microblocks, some DC values are quantized well, and others are not, the 
whole reconstructed picture looks blocky. This is always in the VCD images because its 
bandwidth is more limited compared to MPEG2 video. Real-time encoded MPEG2- 
video on camcorder or in TV home shopping have the same blocky microblocks 
because encoder must run at the real speed to process all the images. 

A block noise filter is designed to reduce the harsh DC quantization impact in recon- 
struction. 

2.0 Previ ous Methods ■ 

An old method is to collect DC values from all the microblocks in the picture and low 
pass them. > 
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3.0 Disadvantages of Old Methods 

The old method violates the image reference defined in MPEG2 specification because 
the current image may be used as a reference for future images, so that any change in 
one image may be propagated to other images. 

In addition, the old method is not adaptive. It requires the DC values from all microb- 
locks, which demands a high bandwidth and usually is only possible in software decod- 
ing. Not all the microblocks should be treated the same. 

4.0 Construction of New Method - 



Please refer to the attached document. 

5.0 Details of Operation 



please refer to the attached document 

6.0 Advantages of New Method 

The new method only requires few microblock DC Values, which is feasible in hard- 
ware. It is adaptive, only filtering the region where the blocky-ness is the most signifi- 
cant and leave alone the original details in the active region untouched. 

no alternate method Of construction to date. 



7.0 Joint Venture Contribution 



The complete idea was started from scratch. Darren Neuman contributed a lot in the 
concept and algorithm, Ning Xue built the lab test and collected the preliminary results, 
refined the algorithm and implemented the filter in hardware. 

8.0 New Features 



none. 
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9.0 Relative Value of Invention 



This invention is very valuable because it allow our product to outperform other sin the 
market and provide low-end encoded resource improved quality. It is practical and effi- 
cient, hardware sample test results are very positive. This feature can be very attractive 
in the DVD market like China and the real-time encoding market like portable cam- 
corder. 
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Anti-block noise filter 
NingXue, 



Purpose of Development: 

remove blocky artifacts in VCD titles and low-quality DVD titles like 
real-time encoded DVDs. This is to ensure flat background is not blocky 
during normal speed display and Mgh quaMty of slow speed and freeze 
playback* 

- User can control the filter regarding to title encoding qualities by 
programming host re^ chroma anti-block 
filter can be enabled or disabled separa^ 

- anti block-noise filter should support all existing dkplay conh-dller 
features (display modes/horizontal filtering) provided on L64020/21 
decoders. , / • 
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Filtering Algorithm: 

— what should be filtered? block boundaries. In encoding, motion blocks 
allocate more bandwidth than background blocks 

~ Difficult to build a filter that filters all block boundaries without 
damaging picture details/M^ frequency components a^ 
boundaries. --> which block boundary should be filtered? 

human being eyes are sensitive to blocky artifacts in flat region, not 
activity/motion block. 

~ How to detect a flat block? --> Variance of the block. 

And how to filter the block boundary? 
« Horizontal and vertical 

tap of a filter/phase shift 

hardware limitation 
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-Display Controller block diagram fluma only) 

line buffer: up to 4 lines of luma value, I-port buffer: 1 line of luma value 
anti block filter 



B 

.O' 

CO 




luma line buffer 



T 



h_sync/v__sync- 



tuma line buffer control 



luma addr. gen 



arbitration 



time gen 
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Modified filtering algorithm: 

Partition an 720 x 480 image into 90 x 480 subblocks, each of which has 8 pixels in 



a row. 



block boundary 




Let luma value of each pixel be Lij, and define Xij to be the average mean of the 
subblock and Vij be the average variance of the subblock, i.e. 



k=7 k=7 2 

Xy=l/8 X Li ( 8 *i +k > V«=l/8 E (Li(8*j+k)-X«) 



k=0 



k=0 
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Horizontal filtering: 

Only pixels next to the vertical boundaries of a 8 x 8 block filtered. To filter 
columns further away from vertical boundaries, a bigger filter is a must. 

— Is line variance itself sufficient? 

No, the dc offset condition should be monitored: It is checked to avoid anti block- 
noise filter blur character display on the screen. The characters carry little variance 
however sharp dc offset from the background. 

-- line variance, line mean 

— tap-5/tap-3/tap-2(easier to implement?) 

— luma filter/chroma filter 
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Vertical filtering: 

— hardware limitation : no vertical line mean or vertical line variance 

— store mean and variance of previous line + current line in the line buffer 
For previous line data: 

— use subblock mean and variance only, store mean value and "variance < 
varjh" (true/false) 

— 2 lines of data --> only filter the top line in a block 
For current line data: 

— access to current line buffer is a problem as line buffer is 1-port and has to 
service SDRAM controller and Vertical filter. 

— or to duplicate current line buffer, 8 words per read-> gate count 

— more rely on dc offset information. 



- tap-3/tap-2 
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filter region (luma only) 

8x8 block 
boundary 



Vertically filtered 
region 



VA ..:■■.'=■ 

horizontally 
filtered region 



both verticajUy , 4 
and horizont ally 
filtered region ; 
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Horizontal filtering 



ieanh 



LiOt+<) Li{k+7; ; Li<k+«) 



meaiiXtf 
Variance Vtf 



If Vy < Var_th-and V|n+i) < var_th and 



meanXio+l) 
Variance Vio+D 



11 - y « <* var_m ana v iq+d 
absCXij - XiQ+x)) < meaiij 

Li(fc-»-7) = V3 (Li(k+tf) + Li(k+7) + Li(k+»)) 



mean X(i-l)j Variance V(i-i)l 



Li(k+2 



Li(k+3: 



Ll(k+4 



mean Xu Variance Vtf 



Vertical filtering 

If Vfi.Dj < Var_th and V» < Var_th and 
absfX^.xy - Xy) < mean Jh 

L i(k+3> = 1/2 ( mean (i-l)j + L i(k+3>) 
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How to compute variance? ^ 

- computation intensive, each ium^ 

difference respectto subblock me^ can be 9 bit-long 

~ great amount of calculations, !^ square calculations/per pixel, 1 for luma, 
2 * 0^25 for 2 chromas 

- no accurate variance calculation is required, piece-wise linear solution is 
acceptable 

approximation of X : 

Define X = X7X6X5X4X3X2X1X0 

X 2 -X 7 0X 6 0X 5 0X 4 («30X 2 0X 1 0X o O 

- for negative X, convert to positive then use approximation or pad 1% then 
take absolute value 



- when X is big* the square cakul&ibn^ ignored as the output is 
assumed out of threshold 
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Problems left: 

1. The algorithm is not complicated. Has this been used? 

2. Hardware implementation: 

2.1 Anti-block filter support all display modes? 

2.2 possible to insert anti-block filter while keeping timing? 

2.3 to access line buffer data or duplicate it elsewhere? timing vs. gate count 
3 How does NTSC compared to digital betacam test equipment? 
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workflow: 



MPEGl programmed bs. 



VCD 



PC 












Workstation 





System --> elementary 



MPEGl elementary bs. 
frame store (352x240) 

352x240 YUV 

2 fields, 240x720/field 

720x480 YUV 



MPEG2decode 



anti-block filter 



020 DC display 



interlace 



YUVtouyvy 



monitor 



abekas 



720x480 uyvy 
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Source materials: 

VCD titles; "Terminator H" (battle field, in the elevator), "007: 
Golden Finger" (card game) 

1. battle field: laser beam, wheel of tank, sky background, skulls 

2. in the elevator: wall of the elevator, terminator's jacket, human 
being faces 

3. card game: human being hand, characters 

VCD/MPEG1 video: 352x240 »> 720x480, each block is scaled by 
2 in each dimension 

Video sequence displayed: 

original video --> filtered video --> original frame vs. filtered 
frame «> 4 in 1 screen 
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